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DETAILED ACTION 
Response to Arguments 

In view of the Appeal Brief filed on 1 1/23/2005, PROSECUTION IS HEREBY 
REOPENED. A new ground of rejection is set forth below. 

To avoid abandonment of the application, appellant must exercise one of the following 
two options: 

(1) file a reply under 37 CFR 1.111 (if this Office action is non- final) or a reply under 37 
CFR 1.113 (if this Office action is final); or, 

(2) request reinstatement of the appeal. 

If reinstatement of the appeal is requested, such request must be accompanied by a 
supplemental appeal brief, but no new amendments, affidavits (37 CFR 1.130, 1.131 or 1.132) or 
other evidence are permitted. See 37 CFR 1.193(b)(2). 

Claim Rejections - 35 USC §102 

1. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

2. Claims 1-12, 29, 36-56, 73, 80-87, and 90-91 are rejected under 35 U.S.C. 102(e) as 
being anticipated by U.S. Patent Number 6,418,439 to Papierniak et al.. 
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3. Papierniak teaches the invention as claimed (As in exemplary claim 90) including a 
browser apparatus for use in providing access to an apphcation by a user through one or more 
computer-based devices, comprising a machine readable medium containing computer 
executable code (col 9, lines 25-53) which when executed permits the implementation of the 
steps of obtaining the application from an application server (col. 9, lines 25-53), the apphcation 
being programmatically represented by interaction that the user is permitted to have with one or 
more computer-based devices by interaction-based programming components (col. 9, lines 25- 
53), wherein the interaction-based programming components are independent of 
content/application logic and presentation requirements associated with the apphcation (col. 9, 
lines 25-53); and transcoding the interaction-based programming components on a component by 
component basis to generate one or more modality specific renderings of the application on the 
one or more computer-based devices (col. 9, lines 25-53). 

4. As to claims 1, 44, and 91, they feature the same limitations as claim 90 and are thus 
rejected on the same basis as claim 90. 

5. As to claim 45, Papierniak teaches an apparatus wherein one or more processors are 
distributed over the one or more computer-based devices (col. 9, hnes 25-53). 

6. As to claim 46, Papierniak teaches an apparatus wherein at least a portion of the 
application is to be downloaded from a server to at least one of computer-based device, acting as 
a chent, fiirther comprising the step of including code in the application operative to provide a 
connection to the content/apphcation logic resident at the server (col. 9, lines 25-53). 
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7. As to claim 47, Papiemiak teaches an apparatus wherein the content/application logic 
connection expresses at least one of one or more data models, attribute constraints and validation 
rules associated with the appHcation (col 9, lines 25-53). 

8. As to claim 48, Papierniak teaches an apparatus wherein one or more modality specific 
rendering comprise a speech-based representation of portions of the application (col. 9, lines 25- 
53). 

9. As to claim 50, Papierniak teaches one or more modality-specific renderings comprising 
a visual-based representation of portions of the application (col 9, lines 25-53). 

10. As to claim 51, Papierniak teaches a visual-based representation based on HTML (col 9, 
lines 25-53). 

11. As to claims 52-54, Papierniak teaches user interactions declaratively and imperatively 
represented by the interaction-based programming components (col. 9, lines 25-53). 

12. As to claim 55, Papiemiak teaches interaction-based programming components 
comprising basic elements associated with a dialog that may occur between the user and one or 
more computer-based devices (col. 9, lines 25-53). 

13. As to claim 56 Papiemiak teaches interaction based programming components 
comprising complex elements, the complex elements being aggregations of two or more of the 
basic elements associated with the dialog that may occur between the user the one or more 
computer-based devices (col. 9, lines 25-53). 

14. As to claim 73, Papiemiak teaches a step of providing a mechanism for defining logical 
input events and the association between the logical input events and physical input events that 
trigger the defined logical input events (col. 9, lines 25-53). 
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15. As to claim 80, Papierniak teaches a step of including code for permitting changes to 
rules for transcoding on a component by component basis to generate the one or more modality 
specific renderings of the appHcation on the one or more computer-based devices (col. 9, lines 
25-53). 

16. As to claim 81, Papierniak teaches a definition of an underlying data model being 
populated is separated fi-om a markup language defining user interaction (col. 9, Knes 25-53). 

17. As to claim 82, Papierniak teaches a node_id attribute attached to each component and 
the attribute is mapped over to various outputs (col. 9, lines 25-53). 

18. As to claim 83, Papierniak teaches an author provided with a pass through mechanism to 
encapsulate modality-specific markup components (col. 9, lines 25-53). 

19. As to claim 84, Papierniak teaches components which may be active in parallel (col. 9, 
lines 25-53). 

20. As to claim 85, Papierniak teaches a representation and transcoding as being extensible 
(col. 9, Unes 25-53). 

21. As to claim 86, Papierniak teaches a state of the application being encapsulated (col 9, 
lines 25-53). 

22. As to claim 87, Papierniak teaches a representation permitted to reference the 
dynamically generated data and supports callback mechanisms to the content/application logic 
(col. 9, lines 25-53). 

23. As to claims 2-12, 29„ and 36-43, these claims have the same Hmitations claims 46-73, 
78, and 80-87 and are thus rejected on the same basis as claims 46-56, 73, and 80-87. 
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Claim Rejections - 35 USC § 103 

24. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. PatentabiUty shall not be negatived by the 
manner in which the invention was made. 

25. Claims 5 and 49 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent Number 6,418,439 to Papierniak at al. in view of the article entitled "New VXML Forum" 
posted at Cover Pages Hosted by Oasis. 

26. As to claim 49, Papierniak teaches the use of audio views (col. 9, lines 25-53); however; 
Papierniak does not specifically teach the use of VoiceXML. 

The article entitled "New VXML Forum" teaches the use of VoiceXML. 

It would have been obvious for one of ordinary skill in the Computer Networking art at 
the time of the invention to combine the teachings of Papierniak regarding a speech application 
system with VoiceXML because VoiceXML is a form of SGML document. 

27. As to claim 5, it features the same limitation as claim 49 and is thus rejected for the same 
reason as claim 49. 

28. Claims 13-28, 34, 57-72, and 78 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent Number 6,418,439 to Papierniak et al. in view of U.S. Patent 
Number 6,269,336 to Ladd et al.. 

29. As to claim 57, Papierniak teaches the invention of claim 44 however; Papierniak does 
not expHcitly teach the use of conversational gestures. 
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30. Ladd teaches interaction-based programming components represent conversational 
gestures (col 12, lines 30-67). 

31. It would have been obvious to one of ordinary skill in the Computer networking art at the 
time of the invention to combine the teachings of Papiemiak regarding the transcoding of 
application components with the teachings of Ladd regarding the use of conversational gestures 
because conversational gestures facilitate interaction with a user and an application component. 

32. As to claim 58, Ladd teaches conversational gestures comprising a gesture for 
encapsulating contextual informational messages to the user (col. 12, lines 30-67). 

33. As to claim 59, Ladd teaches conversational gestures comprising a gesture for 
encapsulating contextual help information (col. 12, lines 30-67). 

34. As to claim 60, Ladd teaches conversational gestures comprising a gesture for 
encapsulating actions to be taken upon successful completion of another gesture (col. 12, lines 
30-67). 

35. As to claim 61, Ladd teaches conversational gestures comprising a gesture for 
encapsulating yes or no based questions (col. 12, lines 30-67). 

36. As to claim 62, Ladd teaches conversational gestures comprising a gesture for 
encapsulating dialogues where the user is expected to select from a set of choices (col. 12, lines 
30-67). 

37. As to claim 63, Ladd teaches a gesture comprising a subelement that represents the set of 
choices (col. 12, lines 30-67). 

38. As to claim 64, Ladd teaches a gesture comprising a subelement that represents a test that 
the selection should pass (col. 12, lines 30-67) 
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39. As to claim 65, Ladd teaches a gesture comprising a subelement that represents an error 
message to be presented if the test fails (col. 12, Hnes 30-67). 

40. As to claim 66, Ladd teaches conversational gestures comprising a gesture for 
encapsulating rules for vahdating results of a given conversational gesture (col. 18, lines 56-65). 

41. As to claim 67, Ladd teaches conversational gestures comprising a gesture for 
encapsulating grammar-processing rules (col. 18, Hnes 56-65). 

42. As to claim 68, Ladd teaches conversational gestures comprising a gesture for 
encapsulating dialogues that help the user navigate through portions of the application (col. 12, 
lines 30-67). 

43. As to claim 69, Ladd teaches conversational gestures comprising a gesture for 
encapsulating a request for at least one of user login and authentication information (col. 21, 
lines 25-40). 

44. As to claim 70, Ladd teaches conversational gestures comprising a request for 
constrained user input (col. 12, lines 30-67). 

45. As to claim 71, Ladd teaches conversational gestures comprising a request for 
unconstrained user input (col. 12, hnes 30-67). 

46. As to claim 72, Ladd teaches conversational gestures comprising a gesture for controlling 
submission of information (col 12, lines 30-67). 

47. As to claim 78, it is rejected for the same reasons as claim 57, as conversational gestures 
are interpreted as natural language. 

48. As to claims 13-28 and 34, they feature the same limitations as claims 57-72 and 78 and 
are rejected for the same reasons as claims 57-72 and 78. 
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49. Claims 31-32 and 75-76 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent Number 6,418,439 to Papiemiak et al. in view of U.S. Patent Number 6,569,207 to 
Sundarsesan. 

50. As to claim 75, Papiemiak does not explicitly teach the use of a Java Bean for 
transcoding components. 

Sundarsesan teaches the use of a Java Bean for transcoding components (col. 9, Unes 6- 

37). 

It would have been obvious to one of ordinary skill in the Computer Networking art at the 
time of the invention to combine the teachings of Papiemiak regarding a speech application 
system with the Java and Java Beans because Java provides multi-platform functionality to an 
apphcation. 

51 . As to claim 76, Papiemiak does not explicitly teach the use of a Java Server Pages for 
transcoding components. 

Sundarsesan teaches the use of Java Server Pages for transcoding components (col. 12, 
lines 29-49). 

It would have been obvious to one of ordinary skill in the Computer Networking art at the 
time of the invention to combine the teachings of Papiemiak regarding a speech application 
system with the Java and Java Server Pages because Java provides multi-platform functionality 
to an apphcation. 

52. As to claims 31-32, they feature the same limitations as claims 75-76 and are rejected on 
the same basis as claims 75-76. 
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53. Claims 30 and 74 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent Number 6,418,439 to Papiemiak et al. in view of the World Wide Web Consortium 
document entitled "Extensible Stylesheet Language (XSL) version 1.0" (hereinafter referred to 
as "XSL version 1.0 specification"). 

54. As to claim 74, Papiemiak does not teach the use of XSL. 

The XSL version 1.0 specification teaches component transcoding performed in 
accordance with XSL transformation rules (Overview, page 7). 

It would have been obvious to one of ordinary skill in the Computer Networking art at the 
time of the invention to combine the teachings of Papiemiak regarding a speech application 
system with XSL because XSL reduces the amount of code needed to create XML objects 
(Overview, page 7). 

55. As to claim 30, it features the same limitation of claim 74 and is thus rejected on the 
same basis as claim 74. 

56. Claims 33, 77, and 88 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent Number 6,418,439 to Papiemiak et al. in view of U.S. Patent Number 6,493,758 to 
McLain. 

57. As to claim 77, Papiemiak teaches the apparatus of claim 44; however, Papiemiak does 
not expHcitly teach synchronization. 

McLain teaches an apparatus with a representation by interaction-based programming 
components permitting synchronization of one or more modality-specific renderings of an 
appHcation on one or more computer-based devices (col. 3, lines 40-65). 
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It would have been obvious to one of ordinary skill in the Computer Networking art to 
combine the teachings of Papiemiak regarding a speech appUcation system with the teachings of 
McLain regarding synchronization because synchronization ensures that the application will be 
provided with up to date data (McLain, col 4, lines 1-6). 

58. As to claims 33 and 88, they feature similar limitations to claim 77 and are rejected on 
the same basis as claim 77. 

59. Claims 35, 79, 89 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent Number 6,418,439 to Papiemiak et al in view of U.S. Patent Number 6,456,974 to Baker 
et al.. 

60. As to claim 79, Papiemiak teaches the apparatus of claim 44; however, Papiemiak does 
not expHcitly teach display aspects. 

Baker teaches code for permitting cosmetic altering of a presentational feature associated 
with one or more modality-specific renderings of an appUcation on one or more computer-based 
devices in an integrated speech based browsing system (col. 3, lines 7-32). 

It would have been obvious to one of ordinary skill in the Computer Networking art to 
combine the teachings of Papiemiak regarding a speech appUcation system with the teachings of 
Baker regarding cosmetic altering changes because combining speech with cosmetic aspects 
creates smarter user interfacaes (Baker, col. 1, lines 15-41). 

61 . As to claims 33 and 89, they feature similar limitations to claim 79 and are rejected on 
the same basis as claim 79. 



Conclusion 
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62. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Douglas B. Blair whose telephone number is 571-272-3893. The 
examiner can normally be reached on 8:30am-5pm Mon-Fri. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Caldwell can be reached on 571-272-3868. The fax phone numbers for the 
organization where this application or proceeding is assigned are (703) 872-9306 for regular 
communications and (703) 872-9306 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3800. 



Douglas Blair 





